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INSTRUCTIONAL THEORY FOR TEACHING STATISTICS^ 

Jan R. .Atwood,' R.fi.^^ Ph. O.- 
Sarah M. Oinham, Ph.D. 
The University of Arizona 



A firm theory base for learning and instruction is essential for 
sound education, according to^both educators and psychologists (Snelbecker 
197^, P. 133]. As early as Aristotle's time^ three laws of association* 
were recognTzeci: contiguity, similarity, and contrast (Hilgard and 
Bpwer 1966, P. 50j^ However, theories of educati.on are primarily de- 
•'scriptive rather than p,resc r i pt i ve and, therefore, not readily useful 
to the classroom teacher (Glaser 1976,'P.6). Instructional models 
based on theories either have not been specified or have not been 
tested, and condit-nons unde r wh i ch -th^ theories obtai ^ have not been 
thoroughly researched. * ' ^ 

The purpose of this study was to^'devise instructional models based It 
on two specific theories and to test whether or not materials based on 
those models helped stat-istics -students learn. The specific area of 
Interest was the basic knowledge' of 'resear^chj analys is" and design; the 
specifier problem chosen was the learning of basic statistical analysis 
by^^graduate s^^udents who are striving to become ' in te 1 I i gen t con.sumers 
or^^<^sumers>^and doers of social science research. \ 

Methatheoret i ca 1 Assessment of. Theory 
The Approach of Dickoff and James ^ 

Many theories of teaching and learning are available to the 'typical 
classroom teacher, but few, if any, theories are practically useful 
because they do not speak specifically to c 1 ass room » cond i t i ons . The 
teacher is left to ded'uce an i ns t ruct i ona'l model from a limited theory 
'requiring a great deal of interpolation and extrapolation. 

, Metatheor i s ts Dickoff and James addressed this quandry as they 
p;roposed a four-level theory framework for practical disciplines such 
^as education .and nursing (Dickoff, James, and Wiedenbach 1968a, 1968b). 
The framework provides a means o,f analyzing theories to explicate the ' ^ 
Idgjc 0/ the contents so that viewers af the ^ theory 'may know its 
'capabilities and limits' as well as specific spots in need of development. 
The four level^ of theory I n ^the' D i ckof f and James frainework are: 



•This paper was presented at the annual meetings of the American Educational 
Research /^S3oc i a t i orrtl March -27 , 1 978. . Inquiries concerning this research" 
should b^e^directed tt the senior author,, at the University of Arizona-"^ 
College xDf Nursling, Tucson, Arizona 8572^k This reseafch was supported in 
part by funds -prov i ded by USPHS Division) of Nursing's Nurse Scientist 
Tr.a i nee Jiiijj) program. , ^ 




I. Naming or Factor-J sol at i ng : we 1 1 -^pec i f i ed definitions of concepts. 

11. Descriptive or^,Factor-Relating: complete d^scri pt ion of relation- 
ships among variables, i'ncluding correlational assertions. 
' f 

1 i'l . Predictive or- Si tuat ion-Relat ing : predictions which may be 
causal' conditions under wh,ich assertions obtain. 

IV. Prescriptive or S.i tuat jon-Produc i ng : causal proposition?, 

directions for producing a desired situation, e.g., learning. ^ 

Level IV is the epitome for a practice discipline (Dickoff et al. 1968a^ 
pp:. ^20-^22) . From another perspective, Glaser (1976, P. 23), an 
educational psychologist, more recently has called for production of 
prescriptive edl^cational designs of immediate use to the classrogm 
teacher. > ' ^ / 

Application To Ayiubel's and Gagne's Theories ^ ^ • 

The two theories of interest in the present study were Ausubel's 
TTieory of Meaningful Verbal Learning and Gagne's Theory of instructioni 
Selectefl bas i c e 1 ement s of both theories have been studied extensively! ' 
but the research has neither been d^fjnitive nor has it concerned <he ^ 
specific conditions under which each theory is useful. Clearly ,ne i the)-'' 
Ausubel's Theory of Meaningful Verbal Learning" nor Gagne's Theory of* 
Instruction is prescriptive (level IV) and ready for general use. '-Both* 
theories 'have weaknesses at each level in the Dickoff .and James taxonomy. 

For example, the def i n i t i ons of key concepts in Ausubel'^ theory. • 
are not clear. On* the whole, h i Sr own writings and research reports 
tend to have several crucial onrissions, e.g., definition of i n it i a 1 • te rm's v 
such as "transfer of training (AusubeT 1962b, p. 6^7)," oV . "af/ect i ve'/ factors' 
influencing learning and retention (Fitzgerald and AusuBel V963, pp. 73^-7^),* 
At the descriptive and correlational levels, the,,elem^ts qf cognitive"^ 
organizers are vague. Unanswei^ed questions include: AtfB all concepts 
amenable to structuring? What is it about a cognitive organizer that 
helps the student? At the predi^ction leVel, which kinds^f learning are 
facilitated by cognitive organization? How many of what kinds of organizers 
does the learner need? ' ■ 

Ausubel recommends that advance organizers be used to form a cognitive' 
framework skeleton on which to- put the content or "meat" df meaningful *^ 
school .^learning (as contrasted with rote memorization), However, the 
precise building blocks for. mean i ngfu 1 learning are not specified tAusubel 
1962a, pp. 213-22^-; 1968, pp. 107-109). Some research has shpwn.that 
"learning consisted of activating the assimilative set quite, early in 
lepr^ning and using it continuously throughout learning, raiher 'than adding, 
more and more different kinds of material to memory (Mayer 1975, p. 53^)." 



Ttie results suggest the need for' advance organizers as well as content 
and perceptual organizers. Additional research has shown that the 
organizers promote ass i mi' 1 a-t ion of information in a broad framework 
(Mayer 1975, P. 5^0),^which tends to promote far rather than near transfei 
of learning. 

On the other hand, a study of 72 bright university students showed 
that transfer of learning of number base concepts was not affected by 
using Ausubel-type advance organizers (G^otelueschen ar>d Sjogren I968, 
p. 201]. Biehler (1971, p. 303) reports' that college students can be 
confused rather than helped, by advance organizers if they^are not 
developmental ly able to handle formal operations. Clearly, research 
about cognitive organj^zers is conflicting. 

At Level III in the Dickoff and James framework, the cognitive 
hierarchy in Ausubel's theory is not firmly established, and although 
evidence is severly limited, a ,few basic pieces of research were done 
to discover the speci/J)c conditions Under which the theory operates. ' • 
For example, when Ausubel, Robbins, and Blake ( 1957^, p. 3^3) tested 
subsumpt ion-dissociabi 1 i ty assfeVtions aboi^ retention and forgetting, 
they found that "proacti.ve rather than retlroact i ve . i nh i b i t i on is, the 
determining factQr in forgett ing ," and that identicaj repetition of 
material is just as useful as interpolated material for facilitating 
retention. The subsumption concept 'in Ausubel's thepry has two' important 
ramifications: initial learning can function to facilitate or inhibit 
subsequent learning, depending on the conditions of recency and type of ' 
previous learning (Ausubel et al. 1957. p. 3^3). It is ' i mporfant to 
note that the methodology in written accounts of the research is hardly 
rep I i cab le. 

Gl aser jand h i s assoc i ates^. at the Unj^yersity of Pittsburg have adapted 
the Gagne m(4del to the Indi'vidual PrescrTbed Instruction System (IPI). 
They claim that reinforcement in the form of immediate feedback is the 
key jnot i vator. for a, student and that a Gagne-type of system enhances 
retention and transfer (Glaser and Cooley 1973, p. 842). The mechanisms' 
of nnotivation, retention and transfer have not been thoroaghly tested. 
Near transfer of learning has been tested at primarily the lower levels • 
of learning rather than the leyels necessary for coMege material. Jn 
addition, the learning material has been job-specific or narrow laboratory 
tasks rather than university subjects (Snelbecker 197^, pp. ^58, 475). * 
Suppes (in Gagne and Gephart 1968,^p. 45)-claims that Gagne-type stimulus- 
response instruction simply does not fa'cilitate transfer. Evidently, the 
conditions under which the theory obtains have not been explicated. Large 
questions of interest to'the educato^r are left unanswered. For instance, 
does the same cognitive hierarchy apply to all kinds of subject matter? 
Nevertheless, the framework of the^theory does exist.' 



Like Ausubel !s, Gagne's Theory of Instruction has weaknesses at each 
level of theory. At the definitional level, Gagne hai proposed that there 



are eight learning types. Unanswered questions include: Do all kinds 
of learnfng -fit i-nto one and only one of the eight -types? Are there 
more types? Fewer? The -h i e rarchy formed by the eight learning types ^ 
is^central to the theory ahd has been used in a variety of edu^ti^nal - 
settings (Gagne 1970, p. 25^), but i^t i s* yet ^unval i dated. Attempts at 
validi^ation have been f^rustrated by insufficient definitional theory. • 
Once validation of t;he theory occurs at each level ,^ meaningful correlational 
studies can be done. Currently, some of the assertions in Gagne's theory 
are correlational, and some are predictive. In addition, t?he' instruct ional 
system devised by Briggs provides a useful prescriptive base. 

t i 

In summ^y, p ract i ca K^app [ i ca t i on of both AusubePs Theory of 
Meaningful Verbal Learning and Gagne's Theory of Instruction is limited 
primarily by weak definitional bases at the first level of theory and 
at the predictive level by unvaljdated learning hierarchies and by poorly 
specified conditions. Ausubel's theory ha's a very weak prescriptive 
component (Lawton, 1977, PP. 25-27). However, use of the Gagpe theory 
i-6 facilitated by a relatively explicit instructional system developed 
by Briggs (Gagne and Briggs, 197M. -io addition, each theory contains - 
some assertions at each of the Dickoff and James four theoret.ical levels/^ 
and*, therefore, each has merjt. ^ 

Fb'cus 'of The Study 

Ty jjtercept foint ^ 

ThJs study concerned the point at which the theories come together 
to describe or predict learning. .Both theories describe the way adult 
l^^arners learn and therefore, both suggest ways jn which teaching can 
tacilitat^e learning. Hov?ever, each theory explains adu It '1 ear n i ng from 
a* different perspective. Ausubel's theory is perhap^s the most fully 
developed cogqitivist position; although* the theory is not well specified, 
i t^ is attractivve because it has been designed and tes^ted for college 
learners. And Gagne's paradigm is Clearly and the most extensively 
developecJ Behavioral , school theory of i n^'t rutt i on ,f or dealing with college-^ 
level complex material^. ^ . . 

Slmjjarities and Differences in the Two Approaches 

The two theories were chiosen both, for their similarity and^for their • 
^differences. "The two'share several characteristics. For example, both 
are spe^ci f i c^l 1 y designed to be useful ip clas.srootn learning and have been 
testfed primarily with college studeats and other adult learners (Ausubel ' 
and Blake 1958; Snelbecker 197^> p7 kjG) . ' Both'are 'current ly debated in^ 
education circles. Both identi.fy en't;ering knowledge as the most powerful 
Inf 1 uence'on subsequent 1 earn i ng both include higher-order concept 
Jearnjng', and both order learnings hierarchically. 

Th^rfe are several key differences between the tvjo theories. They 
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apply the. learning hierarchy principle differently, ^ach -pred i ct i ng 
different resultant le*arnings. The Ausubel parad-^m specifies deductive' 
progression, facilitated by cognitive organizers, through the hierarchy 
from abstract to specific concepts, while the Gagne paradigm specifies 
inductive progression from the highly spec i f i c ,^s. imp 1 es t learning to ' 
the most complex. 

Research Hypotheses 

In the present study, analysis of the propositions offeVed by eacb 
theorist (Gagae, 1977; Ausubel, J968) led to the following hypotheses:" 

1. The Ausubel and Gagne paradigms both faci 1 i't'ate learning, 
better than an instructional approach'not purposely 
geared toward either one. Therefore, The Level of Stat- 
istics L&^inq Is Higher for StudeTits Using ^ Ausubel 
^ or Gagne System Than for Students Using Ne-ither System . 



Both systems are designed to facilitate near and far 
transfer of learrving', but research provides conflicting 
testimony asto the validity of 'each design. Therefore, 
The Level of Near and Far Transfer of Learning is Not 
Different for S t udents . Us i nq Either A Gagne or An 
Ausubel System, and is Greater Than the Level for Students 
Using Neither System .' ^ ^ ' 

3a. Both the Ausubel and Gagne systems ^re*^ des i gned to facial- 
itate concept learning and^^are more effective than heither 
system. Therefore, Level -of Statistics Conrf^pt l earning 
by Students Using an Ausubel System is, Not Differe nt^ Fr'om 
The Level of Those Using a Gagne System; Both Levels Are 
Higher Than Tha-t of Students Using Another bystem. 



^/^N ) 
c c 
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'3]>. The Gagne system is specifically designed to facilitate 
learni.ng up through the problem-solving level. Bo\h the 
Gagne and Ausubel 'systems promote learning bfetter than 
. use of neither system. Therefore-, The Level of Problem- 
SoWJng Ability of Studnets Using a Gagpe System is 
•Higher Than the Ability of Those Us i ng an Ausubel System , 
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Which is Higher Than the Ability of Those Using Neither 
Sys tem , /\ 

(Pg 'Pa '^h ^ ■ ' 

, - ^ ' PS ^PS ^PS • ' 

Research Design and Procedures 

A pretest-post- test control grotjp design was used to assess differences 
in student Vearning^ attributable to either the Ausubel or the Gagne instructional 
system. The pretest-pos t- tes t ccntrol group design was selected-for its strength 
inj contfol 1 ing the main threats tcTinternal validity even though generalization 
of results to an unpretested popu'lation is risky (Campbell and Stanley, 1963, 
p. 13-1 '8). 

The test of the two instructional systems involved multiple independent 
and dependent variables. The model proposed that a student^s gender, pre- 
requisite skills, and pre- instructPonal knowledge, together wi'th the instruction 
the student. receives , predict' the knowledge with which the student leaves ,the 
learning experience. The mode.1 included three, covariates: gend'er (s.elf re- 
ported) ,prerequ i s i fe skills (Iowa algebra aptitude test), and pretest knowledge 
(pretests in ANOVA and cor r,e 1 at i on) » The treatment was either use or non- 
use of supplementary materials according to either Gagne^s or AusubeTs theory. 
The dependent variable was post-test knowledge reflected^by scores on ANOVA 
and correlation postrtests. 



Treatments 
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V^e treatment variable was th^ instructional system based on either 
the Ausubel or the Gegne theory,. The rationale for selection of the two 
theory bases has been discusse.d. Addition of supplementary instructional 
materials', used by the students independently, seemed to be the most 
practical way of assessing in what ways the theory-based instructional 
systems faci 1 i tated* Learnings for university Students who do much of 
their work outside the classroom. In this study, all students received 
Che statistics instruction typically given by the instructor. In 
addition, the students i/i experimental groups Vecei ved supt>l emen tal 
instruction, group -1 , of the AuSubel type, and groujD 2, of the Gagne 
type. The control group Cgroup 3) received no suppfemen^al instruction. 



Treapient M,aterials 



N^ter 



•The supplementary materials were designed to illustrate eaV^, 
instructional system as it wouldvbe Used for the' two main statistics 
topics: analysis of variance (ANOVA) and correl^ation (Dinham 1976, 
Helmstadter 1972, Roscoe: 1 975) , These two'topics w^ere selected because 
they are relatiyely complex, they are very important aspects of basic 

\ ■ ■ ■ ^ 
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data analysis, and they are difficult for the average student to learn. 

Th^ complexity of the topics 'in a learning hierarchy for the AusubeT 

and Gagne models is illustrated by the taxonomies for ANOVl^ and- 

correlation (Illustrations 1 and 2). The two instructional topics are 

important also in that one or the other of the two is basic to nearly 

all education research analyses. Students typically have difficulty 

with ANOVA and correlation for^ several reasons: (l) The language of\ 

the content of the analysis types is new to most of them (2) The \ 

decisions about using one type of analysis or the Cth'er requir^ familiarity 

with many aspects of the data at hand, and (3) most students in beginning - * 

statistics are not accustomed to. thinking in that way. 

Examples of Ausubel (group l) and Gagne (group 2) treatment materials 
for both ANOVA and correlation are shown in Illustration 3. Vhe supple- 
mentary instructional materials were carefully constructed to i^x:lude 
specific organizers, feed-back mechanisms, check quizzes, and othle.r aides* 
suggested by each learning system. The treatment materials were^yal i dated 
for theoretical integrity at several points throughout their dev^ppment. 
The features .of the Ausubel and Gagne instructional systems promfhent 
in the treatment materials were derived from writings by Ausubel (l968) 
and Gagne (igyia, ]3]]d]. Task analysis of the ANOVA and correlation 
content 'based on Gagne's theory were used for both treatfnents because 
Ausubel 's , theory does not specify a taxonomy (Gagne 1971b)\ 

Indep^dent Variables * . 

- ■ / ( 1 

Thfe independent variables were the treatment variable just described 
plus three covariates. Students were assigned to treatments by block 
randomization. The three covariates were gender, level of prerequisite 
skills, and pre- i ns't ruct i ona 1 knowledge of ANOVA and correlation. Gender 
was used because .several studies have demonstrated d i f ferenres" in mathe- 
matics-related learning between ;nales and females. 

The second and third covariates were the aspects of entering behavior 
d"eem^d by both theorists to be the most important pi^edictors of subsequent 
learning: prerequisite skills (algebra aptitude test) and pre- inst ruct i ona 1 > 
knowledge (pretest). The algebra aptitude test was chosen to measure the 
mathematical logic and calculation ability needed for learning statistics. - • 
The Iowa Algebra Aptitude Test' has four subsections: series, lessons, 
open phrases, and dependence and variation. The test is most commonly 
used to measure students' existing cognitive structure in order to predict 
success mathematics courses requiring some algebra proficiency (e.g. 
statistic^). Spearman-Brown split-half reliability for the total t^t 
is 94. The Kuder-Richardson coefficient of internal consistency .i_Qr 
the tot'al test is .93 (Greene and Sabers 1967, p. 5). Predictive valiSity 
for high school modern math and for algebra was .78 and .7^4, respectively, 
and .69 and .64 using teacher grades as the criterion (Greene and Sabers 
1967, p. 3). 
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The, thirtl covari^ate, the statistics pretest^ like the post-tes.t, 
measured students' ANOVA and correlation knowledge (as described below). 

Dependent Variables • ' 

The dependent variable was terminal skill with statistics, i.e.- ■ 
correlation and ANOVA, measured in a total scaAe and several subscores , 
The two -Stat ist i cs topics were tesfed separately. Each test included 
items written to* tap near-transfer and far-transfer processes and to 
assess concept knowledge .and problem solving ability. The eight item 
types vyere \:ombined in various statistically independent groupings 
appropriate to each hypothesis.^ For hypotheses 1 (concerning the main* 
effect of the- instruct ional systems on learn i ng)r'^\ post-test items 
were used. For hypothesis 2 (near-t r.ansf er and far-transfer), near- 
transfer items composed one subscore and far-transfer i.tems.the other 
subscore. For hypothesis 3 (concept learning and problem solving), 
Q^cepX. items were used to., form one subscore* and problem-solving items 
the other. 

In the development of the pre tes ts,' ane^;^ pos t- tes t s , well over 100 
itrems were tested- in pilot studies. Several criteria were used for 
final selection of items for each test: , 

1. An average htem mean of approximately 0.70. 

2. !nc.l<jsion of some mora-1 e-boost i ng items in each. test. 

c ^ . . . 

3. A change in a positive direction from pilot study pretest 

to post-test . • ' >^ 

4. A greater number of concept items* in pretests than in 
post- tests because enter ing knowledge i s- more 1 i kely to 
be concept knowledge than problem-solving ability. 

5. A greater number of near transfer items in pretests 
than post-'tests and the opposite for^far transfer 

^ items because pntering knowledge is more likely to be 

of th^ near transfer than the far transfer type. 

For bot^ pretest and post-test on ANOVA and correlation, hypothesis 
testing required including items to assess knowledge of each topic at 
both the concept and problem-solving levels and for both near and far 
tra/isfer of learning, as previously described. Low pretest re 1 i ab i 1 i^ty^ 
4s tipt unusual due to low variance (S for AfWVA was 1.5 points; S for 
correlation was 2.3). The average pretest i-tem means' for the field 
a study were ,kk and .61 for ANOVA and" correlat iontrespeQt i vely . The 
ANOVA and correlation pretests were successful because the means were 
low (3.3 out af 12 ANOVA points;" 8,53 out- of \h correlation points),^ 
*^ responses were well distributed among alternatives, ai^i students 
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spontaneously reported -fee 1 i ng uniformed aboJt the topics. For the 
ANOVA and correlation post-tests, coefficient alf^ha was .90 and ,89 
respectively. , ^ 

Population and Sample 

> 

The populat^ion to which the conceptual framework speaks consists 
of gradi^te students learning the rudiments of being research consugiers, 
planners, and i mp 1 emente rs . Research methodology, including statistical 
analysis, is a key element' in basic learnings about research. .Thus, the 
target population for the study consists of students enterirrg introductory 
graduate, level statistics courses such as the University of Arizona's 
Educational* Psychology 2^0, Statistical Methods in Educati'on, Most 
commonly the st.udents are Master's and Doctoral students in Education; 
o^thers may be in Nursing, Speech and Hearing Therapy, Ch i Id ' Oeve lopment 
(HQ.me Economics) , and other Social Science and educationally related 
fields. 'The study was designed to general ize .beyond students in this 
particular course to beginning research consumers and doers who have 
chosen graduate school as their place 'to learn statistics. Of particular 
note is the fact that generalization cannot be. made beyond the statistics 
considered because- resea rch has shown that students for whom ,an inductive 
sequence is optimal for one subject matter achieved most from 5^deductive 
sequence with different content (Tobias I976, p. 65). ) 

The original sample consisted of forty-one students who volunteered 
as subjects from an i ntroductory- level graduate statistics course. The 
volunteer sampl^e was considered to be represenfat i ve of the cla-ss as a 
whole because their ^cores on the regular classroom exams prior to the 
experimental treatment were similar to scores of the who 1 e"^ c 1 ass ; mean 
z-s'cores for the sample w^re 0.05 on the fi-rst pre-exper imentaf classroom 
^test and 0.09 on the second. Twenty-one students did not complete the 
^study; two dropped the course, seventeen did not complete both of the' ' 
post-tests, and two reported that they did not use the expe r i fifen ta 1 ^ 
materials. In the final sample, there were six students in the AusubeJ 
group, four in the Gagne group and ten.inM:he cont ro U group Thirteen 
of the twenty subjects were graduate s1[udents in education or related 
fields and eleven of the twenty were women. ^ 

^ Two types of co^ntrol were used in this study:^ randomization of. 
subjects to treatment groups of the^ fnan i pu 1 ated independent variables, 
as discussed earlier,' and constancy among control variables (Leonard 
1971, p. The control var^iables were constant across all condttions 
or treatments for all' hypotheses. 

a. All students had the sacDe instructor (s tvle^^ou r se 
.outline, lecture content, ^ests) . / 

b. ^ All students had identical assignments and handouts. 



c. Both sections wer'e daytime students in degree programs. 

d. Class environment was similar for all students. 



The class sessions were virtually identical; in fact, occas i(pna 1 1 y ^e' 
students went to whi-chever class meeting sui.ted their schedules for the dav 

Pi lot Studies \* 

The tre^ment material for ANOVA and for correlation were pilot tested 
using a design similar to the one used in the maif^st<jdy. As a result of 
pilot testing, selected materials and exam quest;i<^s were revised bas^d .on 
reliability figures ar^|^6edb3ck \o^s completed by s»tudents. Also, 
the pre-test p rocedun^Hks rev i sed to 'enhance student anonymity and 
clarity of"Tns t ruot iq^^^ >^ 



Field Experiment Procedure 
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Students were randomly asS/igned to the control ojxyjp and the two 
treatment groups. After the study was presented to..|Hpents on 'the first 
day of class, i:he volunteer sample took the algebra teft. On the second 
oay of class lYid i v i dua 1 f eedbac^k about the test was given to .any student 
who requ(?sted it. , Prior to'the f[rst lecture"on each topic^ pre-tests 
w^re administered, individual feedback on test performance wis given to' 
^students who requested it, and experimental materials were dTstributed. 
Following the last lecture on each, tooic, pos t-tests "we re admi n i'^s te r6d 
along with the regular class exams ana the usual option to receive 
feedback was also offered. * ^ , ' . ' * ' 



Data Analysis . ^ * " - ^ 

' , • *• ■ . . ■ • •• 

. ^Becab'se no causal ordering was posited among t^e several independent * 
varia'bles, they were cons i dered 's i mu 1 taneous 1 y in the ana lys i s^ mode 1 . A. 
multivariate njpdel assessed the re 1 atJon sh i ps among al I ^Qf 'the i gdependej^t 
and dependent variables in a least spuares solution to 411^1 ineaV model 
(Fennessey, 1968, Woodward and Overall, T975).' The hypotheses . pred i cted . 
the relat i ve. magni tudes of the effects' of the "treatment on eJach- set of J 
dependent var i ables ;* in addition bYvariate analyses, b'etweep each set of 
independent and dependent variables were expected, to shoW that entering 
knowledge is the strongest single predictor of terminal ability-. ' The • ^ 
alpt)a level ojsed for rejection of null hypotheses was p£.05. " r . 

The logical analysis choice for multiple independent variables 
including covariates and multiple dependent variables -^is either analyses 
of covariance (ANACOVA) or tnu 1 1 i va r i ate analysis of covariance (MAf^COVA) 
depending on the statistical i^ndependence among the independent and the 
dependent variables. this case, after assessmen t ,of the nurobeT of 



unique independent and dependent variabl;es and formation of new statistically 
independent .variables , a series of independent ANOVA , ana lyses was^per formed , 



Results and Discussion 



Kypothesjs Tesbs 



Tests of Hypotheses 1, 3b, and the far transfer portion Jbf Hypothesis 2, 
^evealeVf thbt the treatments made no difference in^total lading fn probleh' 
s^olving Y in fa? transfer of .learning, Analysis of Hypothesis 3a showed 
that the jaspects of the concept post-test items which were due to topic 
^ (A^gOVA orj correlation) were relatively unaffected by the independent variables 
However, regression of the concept factor variable on the independent variable 
showed that students in the Gagne treatment group had hjgher concept scores - 
-(p ^ .02). . ^ 

. Effects of the Covariates 1 

Among the covar i'ates Jgender , algebra aptitude and pretest knowledge), 
only gender was meaningful. Being a wom^n was an important 'advantage in 
two ci rcumst^nces : learning ANOVA in general (p ^ ,002) and learning 
concepts in partictjlar (p ^ .001) except for women in the Gagne group * 
(p - .01). There were three women and one m^n in the Gagne group, 

»• 

Both Gagne and Ausubel propose that entering ski Ms and ability are' 
w the strongest de te rmi nat^^ gi. te rm i na 1 beKavior. However, a'student's 
entering skills'and knowledge of algebra do not seem crucial to terminal 
performance in ANOVA or correlation, according to this study. In no cases' 
^ere the pretest scores statistically significant influences on post-te^t " 
scores.. Donsistent with t*be spectrum of current literature, "this study 
showed inconsistent gend^e^r effects on learning outcomes. 

Conclusions and i mp 1 i cat^i ons 

'^^eJg^thents and the three.^covar i ates accounted for an average of 
731 of tfWvariance in th.e post-test scores; further research concerning 
these theories is warranted. Additional research is needeid at all levels 
of both theories; the great gaps seem to be at the definitional leveK 
Further^ val idation of Gagne's learning hierarchy Would greatly facilitate 
use of his theory in the c 1 ass room , , as would specifications of prescriptive 
theory for Ausubel's. . ' . ' 

' * Conclusions for Learning Theory ^ 
AusubeP.s theory has been saW to be weak at Level I, Naming Theory, 
becayse it contains unclear conceptual and operational definitibn^ of key 
concepts such as cognitive organizers: During the development of the \ 
treatment .materials for this study, it was very' d i f f icult to be sure precisely 
^ what were conten4;_organ'i^ers and what were not. At Level 11, Factor-^ehat ing 
. Theory, the literatu^re vvas not at all helpful in delineating how much of a 
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cognitive organizer is Enough, and at Level III, the causal level, how 
many different kinds of organizers suffice to help learners of a given 
typ^ with a given s^ibject matter. In confirmation of Gnote 1 ueschen and 
Sjogren's (I968) resujts, the AusubeT experimental materials did not 
facilitate transfer of learning any better than did the regular classroom 
instruction. It is difficult to assess whether or not the experimental 
treatments were strong enough because little, if any, Prescriptive Theory 
(Level IV) exists ^s a criterion. \ 

Like Ausubel/s theory, Gagne's contains some theory at the def i i« t i ona I , 
fSctor-relating," and correlational levels (l, II, and I U ) , and un 1 i ke 
AusubeTs, Gagne's contains Prescriptive Theory (Level IV) for use by class- 
room teachers. Two chTef problems are the incomplete operational definitions 
of various kinds of learning in the learning hierarchy and IsCck of valida- 
tion of the hierarchy itself. The Gagne experimental materials were specifically 
designed to facilitate discrimination, concept-format-ton, rule learning, and 
problem-solving skills; correspondingly, pretest and post^test* items were 
designed to test each capability. However, one limit of this study is that 
there is room for debate about whether or not each item in each test properly 
assessed the level' of learning f6r which it was desi'gned. Of particular . v 
interest js the fact that learning^of concepts was facilitated ij* ANQVA, but * 
the results of the data analysis do not indicate how important the mastery 
of concepts was for learning rules or solving problems. A second limit of 
the study is the relatively small and unfeven number of i te;nS' used to. assess 
each type of learning as well -as- transfer of learnijng. Even though Gagne 
claims that transfer of learning- is definitely facilitated by his system of 
ins t ruct ion,, Jjhe results of this study do not confirm the. claim. ' . 

A key feature of the Corre lat ionaf , Level II, Theory here is- the 
, reinforcing quality of immediate f ee^dback wh i ch facilitates learning. Even 
though the treatment materials contained n'umerotas and frequent self-tests 
w.ith answers, and prompt feedback was 'o^re'6 for all classroom tests that ^ * 
were part of the study, tfie Gagne group -of students excelled in learning 
ANOVA concepts only. From the Prescriptive Theory, U is. difficult to 
gues/how much' feedback^is enough,' and it is^entirely possible that the 
treatment materials were not strong enough in the other substantive area. 

The fact that the Gagne type of materials helped most with ANOVA may 
be explained by Tobias' (1976, p. 72) comment:' 

T . . students with high pri'or familiarity in a given area 
may be assigned to an instructional treatment, with minimal 
instructional support, or to a forward-branching sequence. 
0,n the other hand, students with low pr ior^achievement m^ 
require maximal instructional support each step of the way. 

This study suggests the following question^ for Ausubet's the<>CY: 
Exactly what are the conceptual and operational definitions of key concepts • 
such as transfer of training (Ausubel , 1962b, p. 6^7)? How much cognitive 
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organization enough? How many kinds of organizers are requ i red-^f or 
given subject matter? ^ 



For Gagne^s Theory, other questions may' be r^e-ised: What are the 
complete operational definitions for the various kinds of learning in the 
hierarchy? Can the learning hierarchy b^ validated? How can it be 
determined that test items properly test the level of learning for which 
they ar^ designed? How mufch feedback is enough to facilitate learning? 

C6nclus'ions for Teaching Statistics 

Both Gagne and 'Ausubel propose that entering skills and ability are 
the strongest determinants of terminal behavior. In this study the influence 
of entering ability was assessed in terms of both prerequisite ski'lls 
(Iowa algebra aptitude test) and pre- instruct ional knowledge (ANOVA and 
correlation pretests). The bivariate correlations between algebra aptitude 
and each preteft^ and also the results of the ANACOVA, indicate that algebra 
aptitude did not influence any of the post-test scores in an iqiportant way. 
Therefore, a student'^ en^e r i ng 4) re requ i s i te mathematical logic and 
ca-lculation ability do not seem crucial to his terminal performance in ANOCA 
or correlation. This news could offer comfort to student and professor 
al i ke . . 

In no>5ases were the pretest scores statistically significant (p£.05) • 
influences on post-test scores. However, concepts and near transfer entering 
ability with both statistical top^i cs showed promise of b'eTng* substarit i vely 
important inflyences upon pos t- tes t concepts and near transfer, respectively. 
The coefficients of determination (r2) were ]8% (p-.l8) for concepts and 
25% (pf.08) for near transfer. Faculty'who are teaching statistics to 
educators maywish to consider pretesting students i/d then focusing their 
teaching on areas identified as weak. 

in this study, , men and women generally learned equally well, except 
that the women learned ANOVA, and especially concepts, better than the 
men. Cqnsistent with the spectrum of current literature, the results of 
this study, show inconsistent gender effects on learning outcomes, and it. 
is unclear how gender operates as a variable. Because gender effects 
are unpredictable, they are worth further attention by classroom teacher 
and researcher alike. 

In summary, it wou 1 d 'cl ear 1 y be wiser to base statistics instruction 
upon a theoret i ca1 lyrba^ed learning hierarchy than not. Just as Murphy's 
law tells us*" If something can go wrong, it will," Woodward ' s" 1 aw warns us 
that "a theory is better than its explanation;" indeed there remain some 
s-ubstantial needs for further speci f i cat ion of the Ausubel and Gagne' 
theoretital approaches. Until su^ch research is done, cla^ssroom teachers 
of graduate students in b^sic statistics could look to Gagne's instructional 
system to help them teach ANOVA and similar concepts. 
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Group I 
ANALYSIS OF VARIANCE 



I. PRE£,IiMINARY CONCEPTS 



•Analysis of variance 'is based on several concepts. It is 
important to understand these concepts before delving into the 
analysis of variance material. - The numbers in parentheses refer 
to pages in the text ( Fundamental R^esearih Statistics for the Be- 
havioral Sciences by John T- Roscoe, 1975 ) on which the terrrts are 
found. All except the last one have been part of the course 
prior to this unit • 



population (p, ^0^ 
sample (p, 20) 
variable (p, 5) 
criterion (p, 198) i 
parameter (p • 21 ) 

statistic (p, 21) ' f • 

random sample (pp, 155-157) 
independent samples (p. 154) 
dependent or related samples (p', 165) 
normal distribution (pp. 45-46; p. 73-83) 
central limit theorem (p. 163) 
sum of squares (pp. 57-69) * 
variance (pp. 69-70) 
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Illustration 3 Continued ^ 4 



III. WHAT IS CORRELATION? % - . 

< - 

All of the descriptive statistics you 'have, used so far- in 
the course- (e*g., mean, median, mode, range, standard devialrion, 

variance) have used one variable. (,Now\e turn to correlation, a 

-ft. 

statistical technique which can be used' for ciescriptive purposes 
but, in contrast to the earlier statistics, describes* the'^rela- 
tionship. between two or more variables. Only the bivar^ate case 
(using two variables) will be considered here. * 

The descriptive statistics you used served t6 describe 
characteristics of disjtrifautions of scores « In addition^ some 
of these statistics were indicators used in hypothesis ^tfesting 
procedures so that population inferences could be made . \ For ex- 
ample, means were used in t-tests . ""-Varianoes were used in F- 
tests in t'he analysis of variance procedure*- Correlation is 

another indicator that tfan be used for inference. 

t 

In previous hypothesis testing procedures j-'two or more 
variables were used. One variable was designated a's a dependent 
variable, and the others were independent variables. Bivariate 
correlation uses two variables, as we]^. "however, neither vari- 
able is designated as- the independent or the de pendent 'i^/zariabie . 
Therefore, correlation coefficients by t hems elvgp * cannot tell us 
anything about cause and effect, that is, which variable "caused" 
the, other to vary. * 

For a descriptiori of correlation, read Section 12.1, 
pages 93-94 in the te^t . 
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Illustration 3 Continued 



Gj^oup II 
ANALYSIS OF VARIANCE 
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By the end of t^iis segment of the course, students who 
have ki^owledge of^most of the key concepts in One~Way Analysis 
•of Variance should be able to: ^ ' ' 



1 

2 
.3 

4 

5, 



Define Analysis of Variance. 
Identify wha-t its uses are. 

Tell what assumptions are made in using the 
technique . 

Compute 0ne-v;ay Analysis of, Variance. 

Give the rationale for doing the 
computations . 

Perform the F test for signpicance amd 
state the outcome of the hylbothesis'^ test . 
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II. PRELIfflNARY CONCEPTS 
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Correlatioll is based cm several concepts which have bee 




part gf the course to date. It is important'to understand 'these 

\ * 

concepts before delving in the correlation material. There are 
two oDtions at this point ^ ^ 

A. To see whether or not you understand the concepts listed 
in SELF TEST 1'*' on the next page, briefly define each one 
in the space provided. Then answer the accompanying 
questions. AFTER you have completed as many as you can, 
refer to the pages in parentheses beside each concept. 
They are found in the course text: Fundamental Research 
Statistics for the 'Behavioral gciences by John T. Roscoe. 
The answers to the^estions are found in pages 141-142. 
^ B. Look up'the conbepts and answers first and then see if 
you can define the concepts and comolete the questions . 

Either way, the important thing is to understand the con-* 

cepts ,be3^?fe going on, ' ^ 

/ 



. '^NOTE: The Self Tests are desiqrfed'to give you a chance 
to. practice using each concept and ta give >;ou immediate feedback 
on your performance. When you come to a Self Test, read it over 
and do all of the items you think you n^ed practice doing. On 
some tests you may elect to dp all of the items, whil# on others, 
you may choose one problem of each type. In most tests aiore than 
one problem ojf each type is- available . 




Refe rences 

Ausubel, David P. "A Subsumptiqn Theory of Meaningful Verbal 
Learning and Retention," Journal of Ge4eral Psych?) 1 oqy , 
Vol. 66 (February 1962a) , 213-22A. ' 

^ ^ • "A Transfer of the Training Approach to improving the 

Functional Retenti6n of Medical Knowledge," Journal of 
Medical Education , Vol. 37, No, 7 (July 1962b) , 6^7-655. 

o Educational Psychology: A Cogn i t i ve, V i ew . New York: 



' . Holt, Rinehard and Winston, inc., I968 

and Elias Blake, Jr. "Proactive Inhibition in the For- 
getting of Meaningful School Material," Journal of Educa - 
tional Research , Vol. 52 (December 1958), 1^5-1^9. 

, Lillian Cukier Robbins, and Elias Blake, Jr. "Re^lLic- 

tive Inhibition and Facilitation in the Learning of School 

Materials, " Journal of Educational Psychology , Vol. ^8 
(October 195-7) 33^-3^3. 

Biehler, Robert F. Psychology Applied to Teaching . 2nd ed. 
Boston: Houghton Mifflin Co., 1971. 

Campbell, Donald T. , and Julian C. Stanley. Experimental and ) 
Quasi-Experimental Designs for Research/ . Chrcago: "Ra"nd 
McNal ly and Co. , I963. 

Dickoff, 'James, Patricia James, and Ernestlxiie Wiedenbach. "Theo- 
. ry^n a Practice Discipline:" Part ''i Practice Oriented 

^\ The^," Nursing Research , Vol-. 17, No. 5 (September- 

October 1968a) , ^15-^35 ^ 



, Patricia James, and Ernestine Wiedenbach. "Theory, in a 

• Practice Discipline: Part II. Practice Oriented Re- 
J ' search, " Nursing Research , Vol. 17, No., 6 (November- 
Dec^ember 1968b), 5^5-55^." 

Dinham, Sarah M. Explor.igg Statistics: An Introduction for 

Psychology and Edjucation . Monterey, Calif. Brooks/Cole 
• Publ ishing Co. , |976. 

<^ ^ 

Fennes^ey, James. "The General Linear Model: A New Perspe.ctJ ve 
on Some Familiar Topicj," American Journa'l of Socio fogy , 
Vol. 7^, No. 1 (July 1968) , 1-27. '. 



ERIC 



24 



Fitzgerald, Dona-ld, andl^avid P. Ausubel. "Ccllfh i t i ve Versus 

Affective Factors^in the Learnirig and Reten^^on of Contro- 
versial Material," Journal of Educational Psychology , 
.Vol. 5^, No. 2 (March-April I963), 73-8^. 

* > 

Gagne, Robert M. The Conditions of Lear^ning . New York: Holt, 
Rinehart and Winston,' Inc., 1970, ^ 

it 

Gagne, Robert M. The Conditions of Learning, New York: Holt, 
Rinehart and Winston, Inc., 1977- 

• "Identifying Objectives: Task Description,',' in I nst ruct- 

lonaT Design: Readings , ed. M. David Merrill. Englewood 
Cliffs, N. J.: Prentice-Hall, Inc., 1971a, 86-88. 

• "Learning Hierarchies," in Instructional Design: Rejadings , 

ed. M, David/<err i 1 1 . Englewood Cliffs, N.J.: Prentice-Hall, 
Inc. ,* 1971b, 118-132. 

. "The Learning of Concepts," in Instructional Desic^n : 
Readings , ed . M, David Merrill. EnJlewood CI iffs , N. J. : 
Prentice-Hal 1 , Vnc, , 1971c, 296-302/ 



Gagne, Robert M. "The Reasons for Specifying Objectives*" in 
Inst ruct iot^gl design: ^Readings , ed. m\ David Me'rn 1 1 . 
Englewood U 1 f f s^^'': J . : Prentice-Hal 1 , Inc., 1971d, 

v^8i-85. y 

and Leslie J. Briggs. Principles of Instructional Design , 

New York: Holt, Rinehart and Winston, Inc., 197^,* 

and William J. Gephart. Learning Research and School Subjects 

Itasca, 111.: F. E. Pearl , I968. 

Glaser, Robert, "Components of a Psychology of Instruction: Toward 
a Science of Design," Review of Educational Research , Vol. ^6, 
No. 1 (Winter 1976), 1-2^. 

and William W. Cooley. "Instrumentation for Teaching and 

and Instruction Management," in The Second Handbook of 
Research on Teaching , ed. Robert M. W., Travers. Ch-icago: 
Rand McNally Publishing Co., 1973. < ' 

Greene, H.A. , and Darrell Sabers. Iowa Algebra Aptitude Test :*- 

Examiner's Manual . 3rd dd. Iowa City: Bureau of Educational 
Research and Service, University of Iowa, (1967 



2o 



Grotelueschen, Arden, and Douglas D. Sjogren. "Effects oV Oi fferent'i al 
Structured Introductory Materials 'and Learning Tasks on Learning 
Tasks on Learning and" Tra/sfer," American .Educational Research 
Journal ,^ol . 5, No. 2 (March "f968) , 191-202. . = 

Helmstadter, Gerald C. Supp 1 ementa ry Ma te r i a 1 s for EP 55^. fejultr- 
- variate Statistical Procedures . Tempe : Arizona State 
Un i vers I ty , 1972. ^ ^ 'v 

\ , 

- and Gordon H. Bowe r . Theor i es Q,f Learn.irjfl . NeW York: 

Appleton^Century-Crofts, Inc. , 1966. ~^\^ * 

Lawton ,^Jos^,ph T. "The Us^ of Advance Organizers in the Le^rnlni 
and Retention of Logical Operations and Social Studies 
Concepts." Ame^ic^n Educational Research Journal,, 
Vol. 14, No. 1 (Winter 197,7) , 25-^3. ~ ^ 

Leonard, Robert V. "Ceteris For tu i t i s S tat i s t i ca 1 Inference and 
y-' Causal Theory." Paper presented at the Annual Meeting, 
Ohio, Valley Sociological Society, C*leveland.,/7^pr i 1 I97I. 

Mayer, Richard E. "Information Processing Variables in Learning to 
Solve Problps, " Review of Educational Research , Vol. ^5, 
No. h (Fall 1975K 525-54K 

Roscoe, John T-. Fundamental Research Stat i st i cs for' the Behav- 
ioral St:iencbs . .New York: Ho 1*? , Rinehart and Winston, 
Inc. , 1975. 

Snelbecker, Glenn E. jlearni ng. Theory , Instructional Theory, and 
Psychoeducational -Design . New York: McGraw-Hill Bc^k 
Co. , 197^. 

Tobias, Si^mund. "Achievement Treatment I nte ract i dns , " Review 
q^^ 6f Educational Research , Vol. 46, No. 1- (Winter ''19'7£k) , 
61-74. ^ " - , • 

Woodward, J. Arthur, and John E. Overall. "Multivariate Analysis 
of Variance by Mu 1 1 i p 1 e ,Regress ion Methods," Psycholog i ca 1 
Bui let in . Vol. 82, No. 1 (January-February 1975), 21--32. 



2i] 



